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Landscape paradigm is ubiquitous in physics and other natural sciences, but it has to be 
supplemented with both quantitative and qualitatively meaningful tools for analyzing the 
topography of a given landscape. We here consider dynamic explorations of the relief and 
introduce as basic topographic features "wells of duration T and altitude y" . We determine 
an intrinsic exploration mechanism governing the evolutions from an initial state in the well 
up to its rim in a prescribed time, whose finite-difference approximations on finite grids 
yield a constructive algorithm for determining the wells. Our main results are thus (i) a 
quantitative characterization of landscape topography rooted in a dynamic exploration of 
the landscape, (ii) an alternative to stochastic gradient dynamics for performing such an 
exploration, (iii) a constructive access to the wells and (iv) the determination of some bare 
dynamic features inherent to the landscape. 

The mathematical tools used here are not familiar in physics: They come from set-valued 
analysis (differential calculus of set-valued maps and differential inclusions) and viability 
theory (capture basins of targets under evolutionary systems) which have been developed 
during the last two decades; we therefore propose a minimal appendix exposing them at the 
end of this paper to bridge the possible gap. 
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I. INTRODUCTION 
A. The landscape paradigm in natural sciences 

The general notion of landscape is encountered in many different domains, for instance 

22 . Hopfield]) and learning processes, molecular 



in physics, neural networks (Hopfield nets 
biology [13|, Becker & Karplus] 
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19t Frauenfelder et al.], ecology and evolutionary biology 
Kauffman], or optimization problems, to cite but a few. From the mathematical viewpoint, a 
landscape is simply a function l/:Xi-^IRU{+oo} (more precisely an extended [3(| function 
since it might takes infinite values +oo) associating a real value V{x) to each state iGlof 
the system. ^From a physical viewpoint, the status and definition of V strongly depend on 
the scale at which the system is described, reflecting in the choice of the space of states X. 

Let us give some examples to sustain our exposition. In statistical physics and molec- 
ular biology, V(x) can be the energy landscape if x is the (high dimensional) microscopic 



configuration of the considered system: atomic coordinates in a glass 



15, De Benedetti & 



Stillinger] , spin orientations in a spin glass |l7l Fischer & Hertz] , tridimensional conformation 
of the hundred or more amino-acids forming a protein jis! Frauenfelder], spatial positions of 
bead centers in a granular medium Edwards]. It can also be a (mesoscopic) free energy 
landscape if x is the value of a (low dimensional) order parameter describing the global state 
of the system: spatially average density, overall magnetization, conformational parameter(s) 
for a macromolecule (as for instance its radius of gyration). At a still more macroscopic 
level, x can be a reaction coordinate measuring the progress along a path representing some 
transformation of the system and inscribed on an effective energy landscape. In quite different 
contexts, cost functions encountered in optimization problems are close analogues to energy 
landscapes [3, Attouch Sz Soubeyran], whereas fitness landscapes encountered in ecology and 
evolutionary biology can be cast in the frame of free or effective energy landscapes, up to a 
sign change (namely, by considering the opposite of the fitness). (See j^ . Sherrington] for 
an introductory review). 

Energy or free energy landscapes are currently exploited in stochastic gradient methods 
accounting for the interplay between thermal motion and interaction forces (effective forces 
in the case of a free energy landscape) deriving from the potential x i— > V(x). In complex 
systems (glasses, spin glasses, proteins, for instance) the landscape V typically presents a large 
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number of local optima around which the solution of a stochastic gradient method is trapped 
and travels a long time before going away and visit other local minima. This dynamical 
behavior has been advocated by Giorgio Parisi to encapsulate a meaning of complexity and 



2a, Mezard, 



rugged landscapes are often seen as a mark of complex systems. (See for instance 
Parisi & Virasoro].) 

Although the landscape V(x) is thus endowed with different status and interpretations 
in varying contexts, understanding and controlling the system behavior requires in any case 
a quantitative knowledge of the landscape topography. It is thus of the utmost importance 
to design efficient tools allowing a dynamical analysis of local minima of such a function 
x \— > V{x). We emphasize that it is not just an academic issue since actual energy or free 
energy landscapes of real systems are available through either: 

• a theoretical access from first principles (e.g. molecular interactions, spin-spin interac- 
tions) and/or modeling hypotheses, allowing to write an explicit formula for V(x); 

• an experimental access, for instance for proteins (indirect kinetic or spectral measure- 



ments) 



19, Frauenfelder et al.) 



a numerical access, either through molecular dynamics at atomic scale, yielding the 
energy landscape, either through Monte Carlo sampling of the configuration space ac- 
cording to the Boltzmann distribution, yielding free energy landscapes for the relevant 
order parameter (s) of the system j^fll . Frenkel & Smit]. 



B. Dynamical analysis of a landscape topography 

We here propose a theoretical and algorithmic analysis allowing us to determine quantita- 
tively the landscape relief of a function V, e.g. location of wells, location and heights of the 
barriers associated with a given dynamics for exploring the landscape j^l]]. It gives access to 
a hierarchical picture of the landscape and allows us to determine the nesting of wells and 
barriers at different scales. 

Given a dynamic exploration mechanism (such as a stochastic gradient dynamics), we 
define the "wells of velocity A, duration T and altitude y" as the sets of initial states ieX 
"below the level y", i.e. V{x) < y, from which at least one evolution governed by the 
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exploration mechanism, and of velocity bounded by A, reaches the rim y of the well at the 
prescribed time T. When the well is not empty, we then evidence intrinsic dynamics governing 
the evolutions from an initial state of the well up to its rim y at prescribed time T. This 
intrinsic exploration mechanism is characterized from the time-derivative of the well, regarded 
as a set-valued map associating with the prescribed duration T and the altitude y the elements 
of the well. Both the wells and their intrinsic exploration mechanism can be approximated 
by finite-difference approximations on finite grids, which allows to implement a constructive 
algorithm. 

This study offers an alternative to stochastic gradient-type exploration mechanisms. In 
quite a similar way of thought, second-order exploration mechanisms of the graph of an energy 
landscape function has been proposed in Attouch, Goudou & Redont]. We here suggest 
to start the landscape exploration with a universal mechanism, independent of the energy 
function, allowing us to look at any possible velocity with prescribed norm A and to retain 
its intrinsic exploration dynamics as a good candidate for a dynamical system exploring the 
given energy landscape. The stochastic gradient method is thus replaced by a differential 
inclusion involving the time-derivative of the well, but allowing in the same spirit the system 
state to escape the trap of local minima, while being quantitatively influenced by their depth. 

The mathematical tools we use are quite novel in physics: They come from set-valued 
analysis (differential calculus of set-valued maps and differential inclusions) and viability 
theory (capture basins of targets under evolutionary systems) which have been developed 
during the last two decades. 

The resulting quantitative topographic description by wells rooted in a constructive dy- 
namic exploration of the landscape and the associated determination of the statistical prop- 
erties of its relief can then be exploited for: 

1. performing a quantitative characterization of the landscape, for comparison or classi- 
fication purposes. It allows to investigate bifurcations, more currently called phase 



transitions in many-particle systems 



2J, Lagues & Lesne]; 



2. providing a quantitative access to the landscape hierarchical structure and allowing to 
estimate its ruggedness, which yields a tentative measure of the system complexity; 

3. defining macrostates and macroscopic variables to be used in coarse-grained descrip- 
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tions of the system. The relevance of such an approach is to provide an intrinsic 
determination of macrostates, founded upon the identification of macroscopic features 
with slow modes and slowly evolving properties 2lJ, Gaveau, Lesne & Schulman]. 



Outline of the paper: - In Section II, we shall define wells, introduce some math- 
ematical features of their relief, and reformulate their characterization in terms of "capture 
basin of a target" , a key concept of viability theory which finds here a unexpected, yet nat- 
ural, application. In Section III, we present the algorithm allowing to construct explicitly 
these wells and the intrinsic exploration mechanism on which it is based. In Section IV, 
we introduce the notion of complete wells, matching more closely with physical landscape 
features. After a conclusive summary in Section V, the essential notions of viability theory 
needed for this paper are presented in an Appendix. ■ 



II. WELLS OF AN ENERGY LANDSCAPE 
A. An efficient alternative to stochastic exploration 

In order to provide both a quantitatively meaningful and quantitative topographic analysis 
of a landscape V on a space X, we introduce "wells of duration T and depth y" . Given 
a dynamical system, allowing upwards steps of velocity bounded by a parameter A, these 
wells are the sets Pv(A;t, y) of initial states "below the level y" (i.e. of states x € X 
such that V(x) < y) from which at least one j^l evolution reaches the upper level y (what 
we call the rim of the well) at time T. In other words, given some tolerance A allowing 
upwards exploration, and some level y, the wells and their depth might be dynamically (the 
experimentally meaningful and operational way) determined according to the trapping time 
T. 

For exploratory purposes, we here implement an alternative to stochastic gradient dy- 
namics and replace stochastic differential equations encountered in physics by differential 
inclusions of the form 



s 

Vt > 0, x'(t) £ F(X;x(t)) 



where x ~> F(X;x(t)) is some set-valued function on X (i.e. F(X;x) is a subset of X) 
parameterized bv a parameter A € M. Compared to a differential equation, the solution of 



a differential inclusion is less constrained since the full specification of the derivative x'(t) 
at each time t is replaced by a constraint on the region F(x(t)) C X where it has to lie. 
Such a tolerance is highly valuable and quite realistic in the modeling of an actual system, 
since the experimentally available knowledge about its dynamics generally provides only 
bounds (or more generally viability constraints) on the kinetic rates, rather than explicit 
pointwise expressions of these rates as a function of the system state. These bounds might 
nevertheless vary with the system state x(t), hence defining a specific set F(x(t)) at each time 
t. For instance, in the case when the function V is differentiable, a close analog to stochastic 
gradient dynamics is provided by 



x'{t) e — VV(x(i)) + \B 

where B denotes the unit ball of the finite-dimensional vector space X. Indeed, the gradient 
dynamics x'(t) = — VV(x(t)) governs evolutions decreasing along the function V, but stop- 
ping at the first encountered local minimum. To overcome this stalling situation, a natural 
idea is to perturb the gradient equation either by a stochastic noise as currently implemented 
in simulated annealing methods or, as we suggest here, by a "tychastic!'' one. Indeed, differen- 
tial inclusion x'(t) E -V7(i(f)) + XB is the "tychastic version" of the stochastic differential 
equation dx = — W(x(t))dt + \dW(t) (see j^, Aubin & Doss] for the links between stochastic 
and tychastic viability). 

However, we have to overcome the fact that the function V is usually not differentiable, 
if obtained through experimental measures or simulations and no longer analytically defined. 
Hence the concept of gradient disappears (when the observable or simulated configuration 
space is discrete), or has to be approximated by gradients of functions interpolating in one 
way or another the experimental data. Any method allowing to bypass these obstacles and 
to deal with graphs of such functions may be worth of being investigated. 

Another suggestion is to leave open the choice of the directions of exploration by looking 
for any way to climb the landscape V to reach a given level y at a given time T. For that 
purpose, we can choose F(X; x) := \B, stating that any velocity of norm A is a priori an 
eligible candidate to apply for such a mission. We shall provide below the way of further 
selecting the most efficient (subset of) velocity (ies), i.e. achieving the most thoroughly and 
the most efficiently, from a numerical viewpoint, the quantitative exploration of the landscape 
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relief. The same type of strategy has been use in previous works for constructing an algorithm 
that is also of relevance for landscapes. This so-called Montagnes Russes Algorithm converges 
to global minima of an extended function jumping over local minima, which amounts to use 
the gradient algorithm to the smallest of the exponential Lyapunov functions above the 
energy function for the differential inclusion x'it) G XB (See jiol. [ill. Aubin & Najman])). 
But whereas this algorithm was devoted to the search of global minima, we are here looking 
for exploratory tools providing a complete hierarchical picture of the landscape. 

B. Definition and characterization of wells 

From now on, we assume that the set-valued map x ~» F(X; x) governing the exploration 
dynamics is given. We denote by y G R the altitude of the well we wish to study, y = is 
set through the (arbitrary) choice of a base level (or, if known and finite, by the lower bound 
on V). Usually, the relevant altitudes are the values of the local maxima or saddle points of 
the function V. We shall associate with it the concept of well P(A;T, y) of duration T and 
altitude y defined as follows: 

1 Wells of a function under a differential inclusion 

Definition II. 1 Consider an extended function V : X t-^ M.U {+00} and a differential inclusion 

Vt > 0, x'{t) € F(X;x{t)) 

Denote by 

S(V,y) := {x £ X such that V(x) < y} and So(V,y) := {x £ X such that V(x) — y} 

the level sets of the function V and by S\ (x) the set of solutions to the above differential inclusion 
starting atx. The well Py(A;T,j/) C S(V;y) of duration T and altitudey of the function V is defined 
by the set of initial states x G S(V; y) such that there exists at least one solution x\{-) € S\{x) such 
that 

(t) V(x x (T)) = y 
(it) Vt S [0,T], V(x x (t)) < y 



We observe that 

Py(A;0,y) = So(V,y) := {x G X such that V(x) = y}. In other words, the well 
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Py(A;T, y) is the set of initial conditions x in the well from which there exists at least one 
evolution x\(-) staying below the level y during a duration T and reaching the level y at 
exactly time T. This does not exclude the fact that for some earlier time t* < T (or some 
later time t* > T), the evolution reaches the level y. This just means that x belongs to the 
intersection Py(A;T, y) n Py(A;t*,y) of wells of several durations. This point can be made 
more explicit: considering the initial state x of the system as a variable and the time to reach 
the level y as the result, we can define the reaching function (A, x, y) \— > £(X,x,y) by 



£(A,x,y) := inf T 

providing the first instant when one evolution starting from x reaches the level y. 

We can also regard the same object by introducing the set-valued map (A; T, x) ~» 
Py (A;T, x) associating with the parameter A, the duration T and the initial state x the 
altitude y of the well the rim of which can be reached at time T by at least an evolution 
governed by differential inclusion x'(t) € F(X; x(t)). 

Turning back to the initial definition, the maximal depth Sy(X; T, y) of the well Py(A; T, y) 
is defined by 

MA;T,y) := sup (y-V(x)) 

x£P v (\;T,y) 

The knowledge of the wells provide some physical characteristics of the landscape V, thus 
bridging the above mathematical definitions with a more traditional description of landscapes. 
We observe for instance that £(X,x,y) is the escape time for the given dynamics, also called 
the first passage time, from above a barrier of top y when the velocity is bounded by A. Its 
inverse [£(A,x,y)] _1 has the meaning of a kinetic constant. 

Denoting Qy(\;T,y) the number of the connected components of well Py(A;T, y), its 
logarithm is the configurational entropy (See 29, Stillinger] and jltl Edwards] for its meaning 



and use in physics, respectively for glasses and granular media): 



a v (X;T,y) := log (« V (A; T, y)) 

In summary, what we are basically looking for is the subset of (x, y, A, T) such that either 
x G Pv(X:T,y), or T > £(A,x,y) or y £ P,"7 1 (A; T, x). As detailed in the next section, we 
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shall give a mathematical characterization of this set as a "capture basin of a target under 
an auxiliary system", allowing to implement a constructive algorithm. We choose here the 
representation of this set through the above concept of well x € Py(A;T, y). 

C. Viability characterization of wells 

The next step of our investigation is to translate the above topographically meaningful 
features in terms of capture basins for which many properties have been establis 
constructive algorithms are available (See the Appendix and for further details, 
Aubin]) and Aubin, Bayen, Bonneuil Sz Saint-Pierre]). 



2 Viability characterization of wells 




Proposition II. 2 Consider an extended function 1/:IhIu {+°°} an d a differential inc 


lusion 




Vi > 0, x'(t) G F(X;x(t)) 




We associate with it the auxiliary system of differential inclusions 






' (i) x'(t) G F(X(t);x(t)) 






(ii) y'(t) = 


(1) 


< 




(Hi) X'(t) = 






(iv) r'(t) = -1 




the constrained set K, and the target C defined by 




K, := £p(V) x 


R+ x R+ and C := Graph(F) x R+ x {0} 




where GraphfV) and £p(V) C X x 


RU{+oo} are respectively the graph and epigraph ofV (see the 


Appendix for a precise definition). 


Then 




Pv(X;T,y) = G X such that (x,y,X,T) G CaptrfJ (X, C)| 




where CaptQJ (IC, C) is the capture 


basin of the target C under evolutionary system QJ) and 


under 


the constraint of remaining in IC (see Deftnition\A.2ibelow). 





Proof — Indeed, to say that (x,y,X,T) G Captr^(/C,C) amounts to saying that there exist one 
evolution x\(-) G S\(x) and a time t* > such that the associated auxiliary evolution 

t^ (x(t),y(t);X(t)-r(t)) = (x(t), y, X, T - t) 
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starting from (x,y,X,T) at t = reaches the target C at time t* while staying meanwhile in /C : 

{ (i) (*(**),», A, r-t*) g c 

\ (it) Vt G [0,**], {x(t),\,y,T-t) G /C 
The first condition is equivalent to both equations t* = T and V(a;(T)) = y. The second equation means that 
for every t G [0, T], V(x(t)) < ?/. These are the very properties stating that s belongs to the well Py (A; T, y), 
or, equivalently, that £ (A; x, y) <T. ■ 

Therefore, the graph of the set-valued map (A, T, y) ~> Py-(A;T, y) inherits the properties 
of capture basins. For instance, it can be shown (using Theorem IA.6I given in the Appendix) 
that the well satisfies a kind of dynamical programming principle which can be stated in the 
following way: 

3 Tracking property 

Proposition II. 3 The set-valued map Py is the unique set-valued map (X,T,y) ~> P(A;T, y) 
satisfying the initial condition 

P(A;0,y) := So(V,y) := {x G X such that V(x) = y} 

the constraints 

P(A;T,y) C S(V;y) 

and the "tracking property" : for any x G P(A; T, y), any evolution x\(-) G S\(x) starting from x at 
time climbing the well until it reaches the rim at time T satisfies 

(*) V*e[0,T], x(t) G P(\;T-t,y) 

(ii) Vs>T such that Vie [T,s], V(x(t))<y, then x{t) G P(X;t-T,y) 



D. Time derivative of the well as an a posteriori exploratory dynamical system 

Since we have related the well of a landscape function to capture basins, the basic viability 
theorems provide tangential characterization of the wells allowing us to find the underlying 
dynamical system governing the evolutions of differential inclusion climbing the wells up to 
their rims. This can be done to the price of using differential calculus of set-valued maps 
(invented in the beginning of the 1980's for this purpose): Knowing the "derivatives" with 
respect to time of the set- valued map t ~> Py(A;f,y) (see Definition IA.10I for a rigorous 
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definition), we obtain an intrinsic exploration mechanism of the well: 
4 The intrinsic exploration mechanism 

Proposition II. 4 For any x £ Pv(X;T, y), those evolutions x\{-) £ S\(x) starting at x and 
climbing the well Pv{X;T, y) in the sense that V(x\(t)) < y for any t £ [0, T] and V{x\{T)) — y 
are governed by differential inclusion 

At) e - W-^ nn^t)) 

In particular, taking for initial exploration mechanism, the set-valued map F(X;x) := XB independent 
of the energy function V instead of exploration mechanisms F(X;x) := — VV(i(t)) + XB already 
dependent of V , we obtain a more intrinsic exploration mechanism. 



Theorem IA. 121 stated in the Appendix gives a technically precise meaning to this sym- 
bolic statement. In other words, the underlying dynamical system governing the evolutions 
climbing the wells up to their rims is the set of velocities v £ F(X; x) pointing to the time 
derivative of the well in order to climb it from — T to in order to reach the rim of the well at 
altitude y. The associated mathematical problem to comfort this intuitive result starts with 
the definition of the time derivative and the proof of this result is based on results of viability 
theory. Let us just mention the informal version of Theorem I A . 1 21 st ated in the Appendix: 

5 Well as a solution to a partial differential inclusion 

Proposition II. 5 The set-valued map Pv is the unique "Frankowska solution to the partial differ- 
ential inclusion" 

Vt>0, xeP(X;T,y), 6 gg^l^ +F(X;x) 
satisfying the initial condition 

P(X;0,y) := S (V,y) := {x e X such that V(x) = y} 

and the constraints 

P(X;T,y) C S(V;y) 



We propose now to check the same statement in the discrete case, which allows us to define 
an algorithm providing the wells under discrete dynamics and the exploratory mechanisms. 
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III. THE SAINT-PIERRE CAPTURE BASIN ALGORITHM 

The Saint-Pierre Capture Basin Algorithm provides both the set-valued map Py and for 
any x € Py(A;T, y), the evolutions climbing the well up to its rim under given duration. 

Let us consider any discrete time approximation $(A; x) of -F(A; x) governing the evolution 
of sequences ~x G S \(x) governed by 



x n+ i € $(A; 

(For instance, : x + hFh(X;x) where h is a time step and Fh an approximation of F 

in the sense that the graph of F^ converges to the graph of F in the Painleve-Kuratowski 
sense) . The discrete version of a well defined by Definition 111.11 for continuous time systems 
becomes: 

6 Discrete wells of a function under a set-valued map 

Definition III.l Consider an extended function V : X i— > Ru{+oo} and a set-valued map (A, a;) ~> 
<J>(A;:e). The discrete time well Pv(A; N, y) C S(V;y) of duration T and depth y of the function V 
is the subset of initial states x £ S(V; y) such that there exists one sequence x £ S\(x) such that 

(i) V(x N ) = y 
in) Vne {0,N}, V(x n ) < y 



In the discrete time, we obtain the intrinsic exploration mechanism under mere inspection: 
7 The discrete intrinsic exploration mechanism 

Proposition III. 2 Knowing the well Py, the discrete dynamical system 

x n+ i e $(A;z„) n PV(A;JV - 7i,y) 

governs the evolutions starting from x G P^(A;iV, y) and arriving at step N at some xm G 
Py(A;0,y) = So(V,y) of the rim of the well P v (X;N,y). 



In the discrete case, the discrete well is obtained by the Capture Basin Algorithm: 
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8 Saint-Pierre Capture Basin Algorithm 



Proposition III. 3 The Saint-Pierre Capture Basin Algorithm yields the discrete well as the in- 
tersection of the following subsets defined recursively by 

( (i) Py(A;0,y) = S Q (V,y) 

\ (it) ViV>0, P v (X;N + l,y) = $(A;-)- 1 (Pv(A;iV,y))nS(Kj/)) 
When $(A; x) := a; + AB, £/ms algorithm can be written 

f (t) Pv(A;0,y) = S (V,y) 

\ (ii) ViV>0, Pv(A;iV + l,y) = (Pv(A; JV, y) + AS) n S(V, y) 



Proof — Indeed, we introduce the auxiliary system ^ by 



V(x, y, A, r) := $(A, x) x {y} x {A} x {r - 1} 
governing the evolution of the sequence 

(i) x n+1 G $(A;a;„) 

(H) Vn + l = 2/n 

(iii) A n+ i = A n 

(iv) r n+ i = T„ — 1 

and the constrained set A3 and the target C defined by 



(2) 



K. := £p(V) x R+ x R+ and C := Graph(V) x R+ x {0} 
Then one can prove as in the continuous time case that 

P v (\;N,y) = I a; G X such that (x, y, A, N) G Captj5j(/C, £)} 
where the subscript © in Capt J^J (/C, C) refers to the discrete evolutionary system 

The capture basin algorithm defines recursively a sequence of subsets C„ starting at Co by 

c„+i := JCn(c„u* _1 (c„)) 

which converges to the capture basin CaptJ^j(/C, C). ■ 



One can prove that whenever the discrete map x ~> &h( x ) '■= x + hFh(X;x) is a time 
discretization of the differential inclusion x'(t) 6 -F(A;x(i)), the graph of the discrete well 
converges to the graph of the well in the Kuratowski-Painleve sense (see {26,27, Saint-Pierre] 
and see 0, Cardaliaguet, Quincampoix & Saint-Pierrel among other references). 
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IV. COMPLETE WELLS 

The concept of well we proposed in Definition III. II is not restrictive enough to match its 
physical counterpart in the sense that it does not require all evolutions starting from a point 
of a well Py(A; T, y) to remain below the rim of the well before time T while one of them at 
least reaches its rim at time T. 

9 Complete wells of a function under a differential inclusion 

Definition IV. 1 Consider an extended function V : X i— » R U {+00} and a differential inclusion 

Vf > 0, x'(t) € F{X;x(t)) 

The complete well WV(A; T, y) C P(V; y) of duration T and depth y of the function V is defined by 
the set of initial states x £ S(V; y) such that 

1. all solutions x\(-) £ S\(x) satisfy 

Vt6[0,T], V(x x (t)) < y 

2. at least one solution X\(-) £ Sx(x) satisfies 

V(x x (T)) = y 



The complete wells can be characterized in terms of absorption and capture basins (See 
for instance Q. Q. 0. Aubin]) and 0, Aubin, Bayen, Bonneuil & Saint-Pierre]). 
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10 Viability characterization of complete wells 

Proposition IV. 2 Consider an extended function V : X t—> Eu{+oo} and a differential inclusion 

V< > 0, x'(t) £ F(X;x(t)) 

We associate with it the auxiliary system of differential inclusions 0). The constrained set K, and 
the targets C are T> are defined by 



and 



Then 



K := £p(V) x R+ x R+ and C := Graph(V) x R+ x {0} 
V := Sp(V) x R+ x {0} 

W v (X;T,y) = txeX such that (x,y,X,T) £ CaptQJ (/C, C) n AbsQ] (K, V) \ 



Proof — Indeed, to say that (a;, y, X, T) £ Capt^ (JC, C) n Abs^ (JC, T>) amounts to saying that 

1. (x,y,X,T) £ Capt^(/C,C), and thus, as we have seen, that x £ Py(A;T,y). 

2. (x,y,X,T) £ Abs^ (/C, 2?) means that for all evolutions Xx(-) £ S\(x), there exists a time t* > such 
that the associated auxiliary evolutions 

t^ (x(t),y(t);X(t);r(t)) = (x(t),y, X,T - t) 

starting from (x, y, X, T) at t = reaches the target T> at time t* while staying meanwhile in K, : 

f (i) (x(t*),y,X,T-t*) £ P 

| («) Vi £ [0,**], (x(t),X,y,T-t) £ /C 

The first condition is equivalent to both equation t* = T and inequality V(x(T)) < y. The second 
equation means that for every t £ [0, T], V(x(t)) < y. 

These are the two properties stating that x belongs to the well WV(A; T, y). ■ 



V. CONCLUSIONS 

Our objective in this investigation was to build exploration dynamics of a landscape V 
associating with a bound A on the velocities of the exploration mechanism, a duration T and 
an altitude y: 
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1. the set Py(A;T, y) of initial states x below altitude y from which starts at least one 
evolution climbing the landscape in order to reach the altitude y at exactly prescribed 
time T; Altitude y might be either a reference level, thus providing access to the depth 
of the well, or chosen among the values of local maxima of the landscape function, thus 
providing access to the height of the barriers separating the well from the other ones; 

2. an underlying dynamical system governing the evolutions climbing the wells up to their 
rims the velocities of the exploration mechanism are consistently chosen among 

At) 6 

Hence, the exploration mechanism is no longer an external stochastic modification of 
the gradient equation, but an intrinsic set-valued method involving the time derivative 
of the well. 

This dynamic description of landscape topography has then been reformulated in the 
framework of viability theory, which provides a constructive algorithm to characterize quan- 
titatively the landscape, built as a intrinsic exploration mechanism of energy landscapes; this 
mechanism could be either a perturbed gradient method or an universal mechanism inde- 
pendent of the energy function. The more refined notion of complete well, introduced is 
Section 4, allows to bridge still more our mathematical definitions and exploration with the 
current landscape paradigm. As discussed in introduction (§ 1.2), our results can then be 
exploited for taxonomic purposes, to investigate phase transitions, to quantify the landscape 
hierarchical structure. It also proposes an alternative to standard stochastic gradient meth- 
ods, namely differential inclusions, in modeling dynamics associated with an experimentally 
determined landscape. 
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APPENDIX A: ELEMENTS OF VIABILITY THEORY 

Let X be a finite-dimensional vector space. A set-valued map F : X ~» X associates to 
any x € X a subset F(x) C X. The set-valued map F generates the evolutionary system 
Sf '■ X ~» C(0, oo; X) associating with any initial state xq £ X the set Sf{%o) C C(0, oo; X) 
of solutions to differential inclusion x'(t) € F(x(t)) starting at Xq. We denote by 

Graph(F) := {(x,y) eX xY\ye F(x)} C X x Y 

the graph of a set-valued map -F : A" ~> Y and T)om(F) := {x £ X\F(x) ^ 0} its domain. 

We shall say that a subset K <Z X is locally viable under F (or under Sf) if from every 
x € if starts at teasi one solution x(-) to the differential inclusion x' E i^(^) viable in K on 
the nonempty interval [0, T x [ in the sense 

Vt G [0,r x [, x(t) G if 

and that if is viable if we can take T x = +oo for any x £ if . Most of the results of viability 
theory are true whenever we assume that the dynamics is Marchaud: 





11 Marchaud maps 


Definition A.l We shall say that the set-valued map F : X Y is a Marchaud map if 




- 

i) the graph of F is closed in X x Y 


< 


ii) the values F(x) of F are convex subsets of Y 




Hi) the growth of F is linear: 3 c > | 




Vx e X, \\F(x)\\ := sup„ eFW H < c(\\x\\ + 1) 


We shall say that F is 


A-Lipschitz if (set-valued extension of the standard Lipschitz property) 




Vi.i'eX, F(x) C F(x') + X\\x - x'\\B 


where B is the unit ball in Y . 



We shall also need some other prerequisites from Viability Theory: 
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12 Capture and absorption basins 

Definition A. 2 Let C C K C X be two subsets, C being regarded as a target, K as a constrained 
set. The subset Capt F (K,C) of initial states xo £ K such that C is reached in finite time, without 
leaving K, by at least one solution x(-) £ Sf{xo) starting at xo is called the viable-capture basin 
of C in K (the solution might eventually leaves K, but only after having reached C). The subset 
AbsF(K, C) of initial states xq £ K such that all evolutions x(-) £ Sf(xo) starting at xo are viable 
in K until they reach C in finite time is called the absorption basin of K with target C . 



Obviously Abs^iT, C) C Captp(if, C). We recall the following result |7|, Aubin & Catte]: 
13 Bilateral fixed point property 

Theorem A. 3 The viable -capture basin Capt (K,C) of a target C viability being with respect to 
the constrained set K) is the unique subset D satisfying C C D C K and 

D = Capt F (A',D) = Capt F (D,C) 
and the absorption basin of K with target C is the unique subset A satisfying C C A C K and 

A = Abs F {K,D) = Abs F (D,C) 



14 Backward invariance 

Definition A. 4 The subset K is locally backward invariant under F if for every to 6]0, +oo[, x £ K , 
for all solutions x(-) to the differential inclusion x' £ F(x) arriving at x at time to, there exists a 
time s £ [0, to[ (depending on the solution) such that x(-) is viable in K on the interval [s,to\. The 
subset K is backward invariant under F if we can take s = for all solutions. 



It is straightforward to check that backward evolutions 9 — > z{9) = x(to — 0) are solutions 
of the differential inclusion z'{9) € —F(z(6)) with initial condition z(0) = xq if a; (to) = ^oi 
we call them backward solutions (starting from xq at time 9 = 0). It is to note that (local) 
backward invariance of K is stronger than (local) viability of K under this backward evolution, 
since all solutions starting in a backward invariant subset K remain in K for a finite time 
(depending on each considered solution in case of the local version of the property) , whereas 
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(local) viability of K only requires that for each point x & K, at least one solution is (locally) 
viable in K. 

We also introduce a weaker notion: A subset D C K is locally backward invariant relatively 
to K if all backward solutions starting from D and viable in K (i.e. remaining in K for a 
finite time) are actually viable in D (i.e. remain in D for a finite time). 

15 Repellers 

Definition A. 5 A subset R C X is a repeller under F if all solutions starting from R leave R in 
finite time. 



Hence, R is not viable, but this does not exclude local viability. It is moreover obvious 
that any subset of a repeller is itself a repeller. 

We can derive the following characterization of capture basin (see P, Aubin]): 

16 Characterization of capture basins 



Theorem A. 6 Let us assume that F is Marchaud and that the subsets C C K and K are closed. 
If K\C is a repeller (this is for instance the case when K itself is a repeller), then the viable- capture 
basin Capt F (_ftT, C) of the target C under F is the unique closed subset D satisfying C C D C K 
and 

!i) D\C is locally viable under F 
ii) D is locally backward invariant relatively to K 



17 Contingent cones 



Definition A. 7 The contingent cone Tl(x) to L C X at x £ L is the set (obviously a closed cone) 
of directions v € X such that there exist sequences h n > converging to and v„ converging to v 
satisfying x + h n v n £ L for every n (see for instance Aubin & Frankowska]). 



For instance, if L is a differentiable manifold in X, Tl(x) coincide with the tangent space 
to L at point x. If the interior of L is non-empty, then Tl(x) = X for any x € Int(L). 

We introduce the following Frankowska property that we need for deriving the system of 
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Hamilton-Jacobi-Bellman equations of which the well is a solution: 



18 The Frankowska property 



Definition A. 8 Let us consider a set-valued map F : X -~+ X and two subsets Ccif and K. We 
shall say that a subset D between C and K (i.e. C C D C K) satisfies the Frankowska property with 
respect to F if 

(i) WxeD\C, F(x)nT D (x)^<D 
it) V x G D such that [351 - F(x) n T K (x) / (Al) 
then - F(x) C T D (x) 

When K is assumed further to be locally backward invariant (then —F(x) C Tk(x) for any x £ K ) 
the above conditions IA1H boil down to 

i) Vi€ D\C, F(x) n T D (x) / 

(A2) 

ii) Vi G D, -F(x) C T D {x) 



(The minus sign in front of F arises when considering backward evolution, governed by 
the differential inclusion z'{9) € —F(z{6)).) 

Theorem IA.6I and the Viability 3(| and Invariance Theorems imply 
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19 Viability characterization of capture basins 



Theorem A. 9 Let us assume that F is Marchaud, that K and C C K are closed subsets and that 
K\C is a repeller. Then the capture basin C&pt P (K,C) is 

1. the largest closed subset D satisfying C C D C K and 

Vx€_D\C*, F(x)nT D (x) / (A3) 

Furthermore, the evolutions x(-) £ Sf(x) viable in K until they reach C are governed by the 
differential inclusion 

x\t) € F{x(t))nT D {x(t)) 

(It roughly means that these trajectories point into D at any point where they reach the 
boundary of D, thus ensuring their viability until they reach C.) 

2. if F is Lipschitz, the unique closed subset D satisfying the Frankowska property I AIM . 

The absorption basin XbsF(K,C) is the largest closed subset D satisfying C C D C K and 

Vie D\C, F(x) C T D (x) (A4) 



We shall apply Theorem IA.9I to the case when subsets K := Graph(i ? ), C := Graph(i^) 
are graph of set-valued maps from X to X and when we decide to regard D as the graph of 
a set-valued map G :Rx X ^Y. We then interpret the contingent cone to the graph as the 
graph of the contingent derivative. We obtain set-valued solutions to systems of Hamilton- 
Jacobi inclusions that this unknown function G should satisfy in order that its graph yields 
the desired capture basin. We refer to Aubin], 12. Aubin & Frankowska] and their 



references for more details on this topic. Here, we recall the definition of contingent derivative 
of a set- valued map and translate Theorem IA. 91 in the framework of wells. 



20 Contingent derivative of a set-valued map 



Definition A. 10 Let us consider a set-valued map G : M. x X Y . The graph of the contingent 
derivative DG(t, x,y) (a set-valued map defined from R x X to Y) at a point (t,x,y) £ Graph(G) 
is equal to the contingent cone to the graph of G at (t,x,y): 

T Graph(.G)( t ' x > y ) = Graph(I>G(t, x,y)) 



22 



Consequently, to say that w £ Y belongs to the contingent derivative DG(t,x,y)(±l,v) 
of G at (t, x, y) in the direction (±1, v) £ R x X means that 

liminf d ( w W±».* + W-v\ =0 

where d is any distance in Y. Since the contingent cone is a closed subset, the graph of a 
contingent derivative is always closed and positively homogeneous (this is what remains of 
the required linearity of the derivative in classical analysis, but, fortunately, we can survive 
pretty well without linearity). 

When g : R x X i— ► Y is single- valued, we set Dg(t, x) := Dg(t, x, g(t, x)). We see at once 
that Dg(t, sc)(±l, v) = ± 99 + d9 g^ ' v whenever g is differentiable at (t, x). The above 
definition (|A.10|) generalizes to set-valued maps a property obviously valid for differentiable 
maps, hence provides a consistent extension of the differentiation to set-valued maps, coincid- 
ing with the plain notion for smooth single- valued maps. Moreover, it is to note that when g 
is Lipschitz on a neighborhood of (t, x) and when the dimension of X is finite, the domain of 
Dg(t, x) is not empty. Furthermore, the Rademacher Theorem stating that a locally Lipschitz 
single-valued map is almost everywhere differentiable implies that x ~> Dg(t, x) is almost ev- 
erywhere single- valued. However, in this case, equality Dg(t,x)(—1, —v) = —Dg(t,x)(l,v) is 
not true in general. We refer to [3, Aubin & Frankowska] for more details. 

Remark: - This is how Fermat defined in 1637 the derivative of a function as the slope of the tangent 
to its graph. Leibniz and Newton provided the characterization in terms of limits of difference quotients. Here, 
too, the graph of the contingent derivative DG(t,x,y) is the upper Painleve-Kuratowski limit of the graphs of 
difference quotients V hG(t, x,y) of G at (t,x,y) £ Graph(G) defined by 

, . , . G(t + Xh, x + hv) - y 
(\,v) i-f V h G{t,x,y)(\,v) := — i '- — a - 

Indeed, we observe that 

Graph^GM^)) = Graph (G)- (t,x,y) {( - RxXxY) 

h 

so that the contingent cone to the graph of G, being the upper limit of the graphs of the difference quotients, 
is equal by definition to the graph of the upper graphical limit of the difference quotients. 

The strong requirement of pointwise convergence of differential quotients involved in the usual derivatives 
can be weakened in (at least) two ways, each way sacrificing different groups of properties of these usual 
derivatives: 

• Distributional Derivatives: Fix the direction v and take the limit of the function x i— > V/,j(i)(d) 
in the weaker sense of distributions. The limit D v g may then be a distribution, and no longer a 
single-value map. However, it coincides with the usual limit (D v g(x) = Dg(x).v) when g is Gateaux 
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differentiable. Moreover, one can define difference quotients of distributions, take their iimit, and thus, 
differentiate distributions. 

Distributions are no ionger functions or maps defined on R", so these distributional derivatives loose 
the pointwise character of functions and maps; on the other hand, this generalization retains the 
linearity of the operator g t— » D v g, mandatory for using the theory of linear operator for solving partial 
differential equations. 

• Graphical Derivatives: Fix the point x and take the limit of the function v i— > Vhg(x)(v) in the 
weaker sense of graphical convergence (the graph of the graphical limit being by definition the Painleve- 
Kuratowski upper limit of the graphs). The limit Dg(x) may then be a set- valued map, and no longer 
a single-value map. However, it coincides with the usual limit when g is Gateaux differentiable. 
Moreover, one can define difference quotients of set-valued maps, take their graphical limit, and thus, 
differentiate set-valued maps. These graphical derivatives keep the pointwise character of functions 
and maps, mandatory for implementing the Fermat Rule, proving inverse function theorems under 
constraints or using Lyapunov functions, for instance, but loose the linearity of the map g i— > Dg(x). 

In both cases, the approaches are similar: They use (different) convergences weaker than the pointwise 
convergence for increasing the possibility for the difference-quotients to converge. But the price to pay is the 
loss of some properties by passing to these weaker limits (the pointwise character for distributional derivatives, 
the linearity of the differential operator for graphical derivatives). ■ 

Proposition 111.21 related the graph of the well to the capture basin 



Py(A;T, y) = |x g X such that (x, y, A, T) € Capt^(/C, C) 

under system 






At) 


E F(X(t);x(t)) 


it) 


y'(t) 


= 


in) 


\'{t) 


= 


iv) 


r'(t) 


= -1 



At this point, we need to introduce the concepts of epigraph and epiderivative of extended 
numerical functions: 
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21 Epigraph and epiderivative of a function 

Definition A. 11 Let V : X i— » R U {+00} be an extended function. Its epigraph £p(V) is the set 
of pairs (x,y) £ X x R satisfying V(x) < y (thus £p(V) C X x Rj. The contingent epiderivative 
D-\V{x) \ X 1 — ► R is defined through the relation 

£p{D ] V{x)) := T £p(v) (x,V(x)) 



We can check that D^V{x) consistently coincide with the usual derivative DV{x) when 
V is differentiable in x and that for any d£X, 



D,V( X )(v) = liminf ^ + ^ " ^ 

is a generalized limit of differential quotients. 

We deduce from Proposition III.2I and Theorem IA.9I the following characterization of the 
well as the unique solution to an initial-value problem of a partial differential inclusion sat- 
isfying viability constraints: 



22 Intrinsic exploration mechanism and the well partial 
differential inclusion 

Theorem A. 12 Assume that the set-valued map F is Marchaud and that the function V is con- 
tinuous. Then the well Py : R+ x R+ xR-^I is the largest set-valued map P : R+ x R+ x R ~> A' 
solution to the partial differential inclusion 

ViG P(A; T, y), F(A; x) n DP(X; T, y, x)(0, -1, 0) / 

the initial condition 

P(X0,y) = S (V,y) 

and the viability constraint 

P(X;T,y)cS(V,y) 
Furthermore, if F is Lipschitz, this solution is the unique solution satisfying 

(i) VzeP(A;T,y), F(X; x) n -DP(A; T, y, x)(0, —1, 0)^0 

(ii) Vx£ P(X;T,y) such that inf veF (\;x) D^V{x)(-v) < 0. 
then — F(X; x) C -DP(A; T, y, x)(0, +1, 0) 
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Proof — Theorem I A. 91 implies that the graph of the well Py '■ R+ x R+ xl-v»l, once transformed 
by the permutation (A, r, y, x) — > (x, y, A, r) of the coordinates is the largest subset T> between C and IC (i.e. 
CcDC/CcXxRxR+x R+) such that 

V (as, y, A, r), (F (A; x) x {0} x {0} x {-1}) n Td(x, y, A, r) ^ 

This amounts to saying that the well Py is the largest set-valued map P satisfying the initial condition 
P(A; 0, y) — So(V, y), the constraint P(A; T, y) C S(V, y) and the contingent solution to the partial differential 
inclusion 

V x € P(A; T, y), F(X; x) n DP(A; T, y, x)(0, -1, 0) ± 

and that the evolutions (t i— > (A, T — t, viable in the well until they reach its rim are governed by the 

differential inclusion 

(0,-l,0,a;'(t)) G ({0} x {-1} x {0} x F(A; x(t))) n Graph(DPv(A; T — t,y, x(t))(0, —1, 0)) 
This can be written 

x'(t) G F(X;x(t))r\DP v (X;T -t,y,x(t))(0, -1,0) 

This is what we meant symbolically above as 

// n r^x , dP v (X;T -t,y) 
x'(t) G F(A;x(t))n ^ ^ 

When _F is Lipschitz (this is the case when F(X; x) := XB (where B is the unit ball in X) the graph of the 
well Py (after permutation of the coordinates as above) is the unique subset D satisfying 

V (x,y,X,r), (F(X;x) x {0} x {0} x {-1}) n Tt>(x, y, A, r) + 
and, whenever (—F(X; x) x {0} x {0} x { + 1}) D Tk(x,v,X,t) ± 0, then 

(-F(X;x) x {0} x {0} x {+1}) C Tt>(x, y, A, r) 

Thanks to the definition of the contingent epiderivative and the fact that /C := £p(V) x R+ x R+, we infer 
that 

(-«,0,0,+l) G Tx,(x, V ,\,t) 
if and only if DfV(x)(— v) < 0. This concludes the proof. ■ 
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